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ABSTRACT 


The performance of four western North Pacific Ocean objective aids (One-way 
influence Tropical Cyclone Model-OTCM; Recurver analog- REC; Total analog-TOTL; 
апа 500 mb steering-CY 50) is evaluated using mean forecast error (MFE), systematic 
error and cross-track (CT) and along-track (AT) statistics. Stratification of these errors 
by storm-related (latitude, longitude, intensity, 12-h intensity change and size) and 
synoptic parameters through empirical orthogonal functions (700 mb easterlies/250 mb 
trough, 700 mb westerlies/250 mb trough, 700 mb easterlies/250 mb ridge, 700 mb 
westerlies/250 mb ridge) distinguishes between different conditions associated with 
tropical cyclone motion. The systematic and CT/AT error results reveal distinct biases 
for each objective aid: 1) OTCM (short-range rightward/slow and long-range 
leftward/fast; 2) REC (rightward/fast), TOTL (leftward/fast); and 43) CY50 
(rightward/slow). The OTCM has the best performance as a result of a small 
systematic bias. The REC analog has large forecast errors on left-turning and 
Straight-moving storms due to its selection of only recurving analogs. The selection of 
analogs from the total sample (TOTL) results in errors due to missed recurvature 
forecasts. Finally, the CY50 has the worst long-range skill because of the lack of the 


physics of OTCM and climatology influence of the analog techniques. 
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1. INTRODUCTION 


Duty forecasters at the Joint Typhoon Warning Center (JTWC) on Guam have a 
variety of objective aids available to support tropical cyclone warnings. The selection 
of the most appropriate aid is often difficult because objective track forecasts usually 
conflict (Fig. 1.1). The trend toward addition of more aids will simpiy cause greater 
confusion. Tsui (1984) has indicated that optimuin utilization of existing aids would 
lead to less confusion and a significant reduction in annual mean forecast errors. This 
deduction is based on the assumption that the current individual aids have potential 
skill. Therefore, forecasters need to be aware of the attributes of the objective aids 
under different conditions so that potential conflicts in guidance can be resolved. 

Tsui (1984) and Elsberry and Peak (1986) have analyzed the performance of 
operational forecast aids in the western North Pacific. In addition to forecasters 
their studies considered track and speed errors in determining the best objective track 
forecast technique. JTWC publishes annually a summary of the performance of the 
objective aids based on average forecast errors only. Recently, Williams (1986) and 
Chan et al. (1986) have analyzed the performance of the Nested Tropical Cyclone 
Model (N TCM) бог different storm-related parameters. However, the accuracy of the 
other aids under different synoptic and storm-related conditions has not been 
examined. This study represents a first attempt in this effort. 

The objectives of this study are: 1) to establish “rules of thumb" for саспа 
under various synoptic and storm-related conditions; 2) to provide objective aid 
attributes that will assist in the modification of existing aids and the development of 
improved techniques; and 3) to provide guidance in the building of a “decision tree” 
algorithm for objectively selecting the best aid (Peak and Elsberry, 1985). A brief 
description of the objective aids selected for this study will be presented in Chapter II. 
The storm-related and synoptic factors to be used in evaluating the aids will be 


discussed in Chapters ЈЕ 
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Figure 1.1 The standard array of JTWC's GEG forecasting aids 
available to support a Dc cyclone warning (12 GMT 19 August 1983 
ropical storm Dom). 


1. ОВО ЕС У ВИ МРУ 


There are four categories of objective techniques for predicting порса са 
motion: l) climatology-persistence; 2) steering flow; 3) statistical; and 4) numerical. 
Currently, JTWC has twelve objecuve aids avauable for шошса! сусјопес ин 
guidance: 


limatologv-CLI MO; 
AC; and Blended 


—. 


і) four climatology. and_ persistence rograms | 
Extrapolation- XRP; laif persistence and climatology 
persistence and climatology-BPAC) 


Cl 
-H 


л 


2) three steering flow programs based on 500, 700 and $850 mb geopotentials 
{(CY30; CY 70 and COSMOS), 


3) three analog programs (Recurver-REC; Straight-STRA; and Total-TOTL) 


4) two numerical tropical cyclone models (Nested Tropical cons M odcel- 
NTCM and One-vay influence Tropical Cyclone Мой -ОТСМ 


A complete description of these aids are given in the JTWC Annual Tropical Cycione 
Report (Joint Typhoon Warning Center, 1955). 

Only four (OTCM, REC, TOTL, CY50) of the JTWC aids were selected domm 
in this study for the years 1981 to 1983. CY50 was the only stecring program archived 
in 1983 and COSMOS was undergoing testing and evaluation during 1983. The 
inclusion of either CLIM, HPAC or BPAC would have further reduced the size of the 
homogeneous data set due to missing verifying positions. The Nested Tropical 
Cyclone model (NTCM) was evaluated in a study by Chan et al. (1986). Since the 
completion of that study, NTCM has undergone various modifications, and it was not 
possible to recompute the desired forecasts (1981 to 1983) with the most recent version. 
Because the emphasis їп this study is placed on forecasting turning motion, the STRA 
and ATRP techniques are excluded based upon a study by Elsberry and Peak (1986), 
who showed that these aids performed poorly for turning storms and long-range 
forecasts, respectively. Thus, four basic categories of objective techniques are 
represented by the aids evaluated in this study: 

[s nun i (OO C AI 

2) steering flow (CY50): 

3) chmatological analog (REC, TOTL); and 
4) climatologv-persisience (CUM Pik 
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The western North Pacific CLIPER (actually WPCLPR) technique that was developed 
by Xu and Neumann (1985) is used as a normalized or no-skill aid to provide a 
benchmark with which to assess the skill of other aids. This prediction scheme is 
based on a series of regression equations using predictors derived from climatology 
(storm location and time of year). persistence (average storm motion over the past 12 
and 24 h) and storm intensitv (maximum sustained surface wind). Forecasts in the first 
24 h rely heavily on persistence, with increasing emphasis on climatology in the 48-h 
ШІ 12-11 forecast periods. A description of the applications of CLIPER to error 


Statistics will be presented in Chapter IV. 


i. THe DATA SET 


A. BEST-TRACK AND FORECAST POSITIONS 

Dr. T. Tsui: and Mr. M. Fiorino of the Naval Envronmental Prediction Research 
Facility (NEPRF). provided the files of best-track information and obce i єє 
forecasts. As in Chan et al (1986), tropical cyclones in the western North Pacific 
between 1981 to 1983 are examined. A total of 356 cases are available а и 
represents only one-fifth of the approximately 2200 tropical cyclone warnings issued by 
JTWC during the 1981-1983 seasons. The requirement that a homogeneous sample be 
compared (Neumann and Pelissier, i98{a) 1s the primary reason for the low number of 
warnings. A second reason is that only forecasts that could be verified at 24, 48 and 72 
hours are included in this studv. 

The errors of this homogeneous set of 356 forecasts are analyzed by comparing 
objective aid forecast positions to (1) best-track positions provided by JTWC and (i) 
the CLIPER forecasts, also provided by Mr. M. Fiorino. Following Chan et al. (1986), 
the CLIPER track is selected as a reference in calculating the cross-track ( CDM 
along-track (AT) components for each aid. The reason for using CLIPER 1s that it is 
a statistical scheme relatively free of any significant bias with respect to actual storm 


track. 


В. STORM-RELATED PARAMETERS 

The five storm-related parameters used by Chan et al. (1986) are also used in this 
study. These parameters include the latitude, longitude, intensity, 12-hour intensity 
change and size of the tropical cyclone. The parameters are extracted from warnings 
issued by JTWC and correspond to the initial times of the forecast. Warning positions 
are used because best-track information would be unavailable to forecasters in an 
operational environment. Frequency distributions of the five parameters have been 
shown in previous literature (e.g., Williams, 1986}. As similar distributions of these 
parameters are found in this study, they will not be shown. 

The five storm-related parameters are partitioned into the same terciles as m 
Chan et al. (1986). Error statistics are then computed for each subsample to 
determine differences in objective aid performance (sce Chapter IV). The terciles divide 


the latitude data into three subsamples (Fig. 3.1): “southern (C E a АИ 
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(between 13°N апа 17°N); and “northern” ( > 17N). The number of cases in each 
subsample is 103, 126 and 127, respectively. Longitude is divided into “western” ( < 
НЕРАВА middle (between 129°E and 140°E) and “eastern” ( > 140°E ). The number 
of cases in each subsample is 113, 127 and 116, respectively. 

The intensity is the estimated maximum sustained wind at warning time. The 
cutpoints divide the data into subsamples which shall be referred to as “weak” (< 55 
kt), “moderate” (between 55 and 90 kt) and “intense” (> 90 kt). The number of cases 
in each subsample is 118, 104 and 134, respectively. The 12-h intensity change can be 
separated into “weakening” (< 0 kt), “developing” (between 0 and 5 kt) and “rapidiy 
мотоа (> 5 kt) subsamples. The number of cases are 71, 149 and 136. 
respeciivelv. It is not possible to get nearly equal sample sizes in this case because the 
e sities arc only recorded to the nearest $ Kt. 

Doa aa eni q parameter (5176) 15 деппед to be the radius of 30 kt (15 
m/s) winds. This parameter is contained in nearly all warnings issued by JTWC. 
When a warning contains more than one radius of 30 kt winds to represent the 
horizontal structure of the storm, the largest radius is selected. If no wind radi 
information is available (maximum speeds less than 30 kt), the cyclone is assumed to 
mec a sze of 55 km ( 30 n mi ). The cutpoints separate the size data into three 
subsamples: “small” ( < 135 n mi ); “medium” (between 135 and 220 n mi) and "large? 
meee J0 nem: ). The enumber of cases in these subsamples is 116, 115 апа 125, 


respectively. 


Cy SYNOPTIC PARAMETERS 

This study represents a first attempt at analyzing the performance of objective 
aids using synoptic parameters based on empirical orthogonal function (EOF) 
representation of the environniental wind fields. Chan et al. (1980) found that turning 
motion 1s controlled by large-scale flow fields surrounding the tropical cyclone. Recent 
 ШШШе5 (5пайПог апа Elsberry, 1982; Peak and Elsberry, 1986; Peak et al, 1986) have 
demonstrated the application of EOF analysis to representation of the large-scale flow 
around a tropical cyclone. A detailed description of the EOF method is beyond the 
scope of this study. Descriptions of this method can be found in Shaffer and Elsberry 
(1982) and Peak et al. (1986). 

Тһе basic EOF technique consists of representing the environmental flow as a 


Ппеаг combination of principal components derived from a large number of synoptic 
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fields. For a particular case, the synoptic information may be efficiently represented by 
the summation of only a few products of EOF coefficients and eigenfunctions. Peak et 
al. (1986) used discriminant analysis to isolate the individual EOF components that 
best distinguish future zonal and meridional motion. The 700 mb zonal mede 2 
(U700-2) and 250 mb meridional mode 2 (V250-2) components have been found to 
classifv 67% and 62% of the cases into the correct zonal and meridional transiation 
puterones respectively (Peak et al., 1986). 

The patterns of the 700 mb zonal (Fig. 3.2a) and 250 mb meridional (Fig. 3.2b) 
components can be interpreted separately as possibie atmospheric flow patterns. A 
positive coefficient multiplying an eigenvector represents the pattern shown, whereas a 
negative coefficient would represent the exact inverse. There is no mathematical 
connection between a specific zonal-field mode and the same mode of the meridional 
field. Mode 2 of the 700 mb zonal flow (Fig. 3.2a) may be interpreted as a tropical 
cyclone embedded in a broad easterly flow. Farther to the north, the U=0 isoline 
indicates he position of the subtropical ridge line. Midlatitude westerly flow can be 
found farther north. Thus, this single mode may provide a realistic representation of 
the trade flow and large-scale midlatitude westerlies. Mode 2 of the 250 mb meridional 
flow (Fig. 3.2b) has alternating bands of positive and negative flow (trough- 
ridge-trough pattern). A positive coefficient multiplying the EOF field in Figure 3.2b 
would represent a synoptic pattern with a trough directly north of the cycione, and 
maces (oO the northwest and northeast. Because the grid is relocated each time relative 
to the tropical cyclone, there is no preferred location relative to the midlatitude troughs 
and ridges. 

ШЕШСЕ соеіпсісиі5 used im this study have been taken from the Peak et al. 
(1986) data set for 1981 to 1983. The cases are stratified into four categories based on 
positive and negative U700-2 and V250-2 coefficients. Since a change of sign indicates 
a completely different flow, positive and negative values of U700-2 and V250-2 
coefficients represent different. synoptic categories. Therefore, the four synoptic 
stratifications are: 


1) 0700-2 > 0.0 апа У250-2 » 0.0 (ie. low-level easterlies and upper-level 
trough to the north), 36 cases; 


2) U700-2 « 0.0 and V250-2 > 0.0 (1е., low-level westerlies and upper-level 
trough to the north), 38 cases; 


3) U700-2 > 0.0 and V250-2 < 0.0 (i.e., low-level easterlies and upper-level ridge 
to the north), 51 cases; and 


4) U700-2 « 0.0 and > 2 < 0.0 (1.e., low-level westerlies and upper-level ridge 
to the north), 48 cases 


The total number of cases in this sample from 1981-1983 is 181, whereas the Peak et al. 
(1986) data set included 319 cases during 1979 to 1983. These cases are analyzed in 
Chapter VI using the same methods described for the storm-related parameters (see 
chap or ls 
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Figure 3.2 Second mode of the a) zonal wind field at 700 mb and b) 


meridional wind field at 250 mb. All 


he dot indicates storm location. 
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values multiplied by 100. 


IV. ERROR STATISTICS 


Following Chan et al. (1986), the objective aids are evaluated in terms of: 1) 
mean forecast error (MEE) relative to CLIPER; 2) systematic 20041 (0208 
meridional (SY) errors; and 3) cross-track (CT?) and along-track (AT) errors relative to 


ас ‚РЕВ Gae 


А. | NIEAN FORECAST ERROR 

Forecast error (FE) is commonly used to verify tropical cyclone forecasts. [tus 
defined as the great circle distance between the forecast and best track (determunegiim 
post-season analysis) positions (Fig. 4.1). Mean forecast error (\IFE) is siniply ша 
sum of the forecast errors divided by the number in the sample. The FE at 12292980 
48, 60 and 72 h for each objective aid and CLIPER are computed for the total ата 
and cach subsample stratified by storm-related and synoptic paramters. The MEE and 
other error components will be expressed in kilometers. 

Though MFE js useful as an absolute measure, it may not provide an assessment 
of forecast skill (e.g., exceed levels achieved by climatology and persistence) ONES 
CLIPER is used as a normalizer, or no-skill model, to provide a benchmark to measure 
the skills of other objective techniques (Neumann and Pelissier, 198ia; Thompson et 
а!., 1931). The differences are displayed in terms of percentage (Р) пїрго еш с ли я 


deterioration relative to CLIPER: 
РОС мера п 2. (228 


where FEc is the CLIPER FE and FEm is the objective aid FE. Negative ай 00:08 
percentages of (P) indicate deterioration and improvement over CLIPER, resoectiaams 
(segue Наршеш дема ци 


D. SYSTEMATIC ERROR 

Systematic error components (SX and SY) are defined as the zonal (óx) and 
meridional (OY) errors averaged over the total forecast sample (Fig. 4.1). These error 
components indicate the presence or absence of longitudinal or latitudinal error bias in 


the sample. A monotonic increase or decrease of error with forecast interval suggests 


2 


the presence of a systematic error. If present, these systematic errors could be 


statistically removed (Peak and Elsberry, 1982). 


C. CROSS-TRACK AND ALONG-TRACK ERROR COMPONENTS 

Just as the systematic errors may suggest biases in the zonal and meridional 
directions, the cross-track (CT) and along-track (AT) errors provide information on the 
direction and speed of tropical cyclone movement relative to some reference track. 
isecrry and Peak (1986) interpreted the CT components relative to a persistence 
forecast as turning motion and the AT components as speed of motion. When CT/AT 
@emponents are calculated relative to a CLIPER ( climatology and persistence ) track, 
the CT and AT standard deviations are nearly equal at each forecast interval (Elsberrv 
and Peak, 1986). In addition, the means in the CT distribution are nearly zero for all 
forecast periods (Chan et al, 1986). However, the mean AT values (not shown) 
indicate that the CLIPER positions are consistentlv in front of those of the best track. 
This is expected because any directional deviation of the storm track from the CLIPER 
track will lead to negative AT errors, even though the total displacements are identical 
(Neumann and Pelissier, 1981a). Since the primary emphasis is on turning motion 
(CT), the nearly symmetric CT distribution supports the use of CLIPER as a reference 
Вега, rather than the persistence forecast used by Elsberry and Peak (1980). 

CT/AT components of the best track and objective aid forecast positions are 
ENculated relative to a CEIPER forecast position at the corresponding time. In Figure 
EnescIAat 72 h is computed relative to a line connecting the 60-and 72-h 
CLIPER forecast positions. The perpendicular distance from the OTCM (or other 
Mejective aid) or best-track position to the CLIPER track is the CT component. 
Positive and negative values are to the right and left, respectively (looxing downstream 
from the 60-h CLIPER forecast position). The AT component is the distance from the 
fe CLIPER forecast to the point at which the perpendicular from the OTCM (ог 
Mest-track) position intersects the CLIPER track. The AT values are positive 


(negative) if the perpendicular meets the track ahead of (behind) the CLIPER position. 


D. CONTINGENCY AND CLASS-ERROR TABLES 

CT and AT components of the best track positions at 24, 48 and 72 h are divided 
into terciles (at the 33.3 and 66.7 percentiles). The motivation for the separation into 
terciles 1s that an objective aid should correctly distinguish between left-turning (L), 


straight-moving (C) and right-turning (R) storms (Elsberry and Peak, 1986). Thus, the 
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Figure 4.1. Definition of forecast and systematic error components 
(SX and SY). In this example, both SX and SY are певанже 


їгс 11:11 00010П5 are labeled.as left (L), center (C) and right (R). Tne AT tercile 
distributions are slow (S). center (C) and fast (F). 

The tercile (CT or AT) in which the objective aid forecast is found is then 
compared with that of the best track for each case in the sample. A 3 x 3 contingency 
КОО Is олива (ог еасп Coimponent and forecast period (Fig. 4.3a).. The number of 
cases along the diagonal from top-left to bottom-right represent “correct” forecasts and 
И гејегтеа со as zero-class errors. [he two-class errors consist of objective aid 
Encssstsvon the opposie side of the CLIPER track compared to the best track. These 
errors are located in the upper-right and lower-left bins. The remaining bins contain 
@me-class errors in which the objective aid forecast is displaced only one tercile from 
NU Nbesr track. 11116585 percentages of each tercile class error for each component and 
ferecast Period may be SUmmarized in a class-error table. For example, the percentage 
ere 1) Cl two-class errors (Fig. 4.3b) for CT at 24 h is higher in the "L^" tercile (26.5) 
в: Ш је R сетсие (12.3). This indicates that the two-class OTCM forecast errors 
E bredkelv-to be-to the might than to the left of the best track (right bias’). 

The lower portion of the class-error table (Fig. 4.5b) summarizes the percentage 
ВИЗ Г КОТ each category (L, C and R or S, C and F) of the sample. Іп the 
above example, the zero-, one- and two-class errors are 43.8%, 43.4% and 12.9%, 
respectively. If a purely random selection scheme had been used, the zero-, one- and 
two-class errors would have been 33.3%, 44.4% and 22.2%. Thus, this scheme has 


skill relative to random selection. 


E. M-SCORE 
A scoring system devised by Preisendorfer and Mobley (1982) ts used to 
quantitatively measure the performance of the objective techniques. The skill of a 


particular aid can be characterized by a “penalty score” M: 


M = V + 2W, (4.2) 


where U, V and W are the percentages of the zero-, one- and two-class errors, and U 
ШИ + W = 100 %. Thus, the M-score is a linear measure which penalizes an 
objective aid more (twice) for having a two-class error. The lower the M-score, the 


higher the degree of skill. For a random tercile selection, each of the nine bins in the 
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contingency table would contain 1/9 of the sample. Therefore, a random selection 
would have an M-score of 88.9. In the previous example (Fig. 4.30), the CT M-score 
for the OTCM is 69.1 at 24 h. 

siccus A ЕЕС ате Сиса relative to CLIPER, the CLIPER forecast 
u бе іп tive center tercile. Thus, the CLIPER forecast will never have more 
than a one-class error, and the terciles by definition are constructed so that 66.7% of 
the cases are adjacent to the center tercile. For both CT and AT components, the 
M-score for CLIPER will агт. d 3b, the OTC CT forecast 


components are worse than those of CLIPER at 24 h (69.1). 
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V. STORM-RELATED PARAMETER RESULTS 


Objective aid performance in terms of storm-related parameters is presented in 
this chapter. Error statistics for the unstratified sample are discussed in the following 
uw unpDdoreesst'ertor ИВ 2) systematic error (SX, SY); and 5) CI/ AT 
error. After the description of the unstratified (total) sample, the sample is then 
divided into three subsamples. For each stratified sample, error statistics are discussed 
for each individual aid. The stratifications are by latitude, longitude, intensity, !2-h 
intensity change and size samples. A performance summary Is given at the conclusion 
of each sample discussion. For case of comparison, figures of mean, systematic and 
EI SI-errors are collected at the ena of this chapter. Due to the large number of 
contingency and class-error results (over 70 figures), only the class errors are shown. 


For ease of reference, the stratified ciass-error tables are collected in Appendix A. 


A. UNSTRATIFIED SAMPLE 
1, Mean Error Results 

Dynamical Model (OTCM). The CLIPER MFE for 24, 48 and 72 h (183, 413 
and 639 km) represent the standard of comparison. The mean error profiles (Fig. 5.1) 
indicate.a close grouping of aid performance in the first 24 h. This close grouping of 
errors at 12 and 24 h may be a result of similar positioning errors. [n their study of 
western North Pacific Ocean forecast errors, Jarrell et al. (1978) found that a 12 n mi 
increase in initial position error may be related to a 20 n mi increase average 24 h 
forecast error. The poor short-range performance of OTCM (10% worse than 
CLIPER) is probably a combination of initial positioning errors and errors that occur 
in the initialization of the model. In longer ranges, OTCM is 12% and 7% better than 
CLIPER at 48 and 72 h, respectively. The large errors in the early periods compared 
to relatively constant skill by OTCM between 36 h and 72 h tends to substantiate the 
existence of an initialization problem. Furthermore, OTCM's long-range skill 
demonstrates the superiority of dynamical models over other techniques such as analog 
and steering (Elsberry and Peak, 1986). 

22022 221 от гапве ресїогтапсс of СҮ50 (596 better than 
CLIPER) compared to the marginal, or no skill of the other aids, implies that the 500 


Y 


mb steering flow may be the best indicator of initial cyclone motion. However. CY50 
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shows a sharp decline in skill after 24 h, and becomes 35% worse than CLIPER at 72 
h. This unsophisticated steering technique, as compared to OTCM, can not account 
for various physical processes responsible for tropical cyclone motion (1.e., beta-ettect, 
barocliic processes, etc.. The OTCM numerically integrates these processes, while 
the analog techniques contain them implicitly through their climatological data records. 
Therefore, CY50 has the worse long-range objective aid performance. 

бес (КЕС unu рег їогтпапсе5 of TOTL and REC are 
essentially similar to CLIPER (within 1 to-299) in the 24 to 48 h period. These results 
for short-term forecasts are not unexpected since both CLIPER and analog methods 
use the same data base, and emphasize persistence in the early forecast periods (0 to 48 
h) However, both analogs show little skill (10% worse than CLIPER) at the 72 h 
projection, which is similar to the analysis of Tsui (1984). Analog studies in the 
Atlantic region (Neumann and Pelissier, 1981b) and eastern Pacific area (Thompson 
and Elsberry, 1981) had similar results. In these studies, the analog methods had large 
forecast errors when the storm had an anomalous track, or an inadequate number of 
available analogs. The CLIPER model used in this study (WPCLPR) was designed to 
eliminate the problem in the analog method of lacking an insufficient number of 
analogs (Xu and Neumann, 1985). However, the problem of anomalous cyclone 
motion is not limited to the analog methods, but exists in all objective techniques. For 
Аватар, errors in forecasting recurvature account for the largest errors in aid 
Ber ormance, especially at the 72 h projection. The slight decline in OTCM skill after 
48 h, and poor performance of the other aids at 72 h, may be attributed largely to 
recurvature errors. 

2. Systematic Error Results 

шог гоо €mmors (Mri) do not provide any direction information, 
systematic error analysis is used as a method of introducing “directionality”. Very 
small zonal (SX) and meridional (SY) errors are shown in Fig. 5.2 for short-term 
objective aid forecasts (9 to 36 km). These errors may be a result of initial positioning 
errors. However, the errors beyond 24 h acquire distinct profiles for each individual 
aid. 

Dynamical Model (OTCM). Although small, the OTCM systematic error trend 
suggests an initial northeastward bias in the 24 h forecast period, followed by a 
westward track bias at the 72 h projection. The 24 h OTCM SX and SY errors (56 and 
48 km) are similar to those found by Chan et al. (1986) for the NTCM. Unlike the 
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NTCM, the OTCM model has a negatively increasing SX error beyond 48 h , whereas 
NTCM's SX errors were insignificant. Similarly, NTCM has very small SY errors (-16 
to 4 km), whereas OTCM SY errors increase monotonically from 48 km (at 24 h) to 
E km (at 72 h). 

The OTCM westward bias at 72 h may be caused by a failure to fully predict 
the right-turning motion of recurving storms. Since NTCM 1s essentially a “nested” 
Eeusron of OTCM, the differences :п biases in the NICM may suggest that the 
pre-processing technique in the OTCM might be responsible (Shewchuk and Elsberry, 
1978). The advantage of the pre-processing approach is that it improves the initial 
storm motion vector (eastward bias in OTCM). However, the disadvantage is that it 
always forces a persistence component into the model, whereas the storm actually may 
be decelerating or accelerating. 

ОВОО ТИ) the REC aid has the largest, positive SY errors of 
ШІ 8104. The 56 h SY error is 121 km compared to a SX error of only 45 km. By 72 h. 
the REC SY error increases to 280 km with a corresponding SX error of 177 km. 
These results imply that REC has an excessive northward bias for the typical storm 
motion toward the northwest. Elsberry and Peak (1986) found that the selection of 
analogs from only recurving tracks (REC) results in large nghtward (northward) track 
biases. Leftward biases were found for the STRA aid (not shown), which selects only 
those analogs that are ^straight-movers". 

ШО os ii C OP bas large, necative SX errors, and only small SY 
errors. The maximum SY value is -46 km (72 h), while SX values increase to -275 km 
ШЕП ТОТГ5 systematic error profile (Fig. 5.2) suggests the existence of a 
westward bias for the typical cyclone track. A similar westward bias was found in 
previous studies of analog aids (Neumann and Leftwich, 1977; Renard and Bowman, 
1976). Elsberry and Peak (1986) suggest that selecting the analog froin the total 
(TOTL) sample tends to compensate for the offsetting SY biases observed in the REC 
ПОЈ КА versions (small TOTL SY errors). As in the case of OTCM, the negative 
SA errors at 72 h are probably a result of errors in forecasting recurving storms. 

Steering (CY50). In comparison to the other aids, CY50 has both the largest 
SA and SY errors, which gives CY50 the worst performance of any aid in terms of 
Mean error (Fig. 5.1). SX errors increase from 131 Km (36 h) to 435 km (72 h) while 
Siueerrors increase from -87 (36 h) to -323 km (72 h). These eastward and southward 


errors imply a slow bias for the typical motion toward the northwest. Chan (1982) 
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found that cyclone motion in the western North Pacific region is usually faster, and to 
the left of the 500 mb steering flow for northwestward moving storms. By contrast, 
cyclone motion is usually to the right of the steering flow for westward moving storms 
(beta-effect). Because most cyclones have westward movement, positive SX errors 
exceed negative SY errors after 24 h. Also, the 500 mb steering flow does not tasca 
account baroclinic phenomena or the beta-effect, which may influence tropical cvclone 
turning motion and cause significant errors in CY50 forecasts. 
32 ХЭГ АТ 0. 

The largest track forecast errors are associated with cyclone turning motion 
(Chan et al., 1980). Therefore, it is helpful to examine CT/AT components ii r 
left (L), straight (C) and right (R) turning, and slow (S), central (C) and ан ий 
categories relative to the storm track. 

Dynamical Model (OTC). The CT/AT characteristics (Fig. 5.3) with time 
show that the OTCM is the best aid for 48 and 72 h path prediction, and for 48 h 
speed prediction. The OTCM CT/AT 2-class errors are highest in the {26% ИОВ 
terciles in the short-term (Figs. 5.1 and 5.5). Durnng this period the OTC VIocormssm 
forecasts 65 to 70% of the right-turning or slow-moving storms, compared to only 
35% of the left-turning or fast-moving cyclones. This 24 h rightward/slow bias 
corresponds to the small initial northeastward trend in the OTCM SX/SY profile (Fig. 
5.2). The NTCM mode! has a similar initial bias (Chan et al., 1986). Thus, the poor 
skill shown by OTCM at 24 h (69 M-score) is primarily due to CT errors caused by 
initial positioning and/or initialization errors. After 24 h, the sharp improvement in 
OTCM skill is associated with a balance and reduction in these 2-class errors. The 
OTCM then becomes the only aid with path prediction skill in the 4$ to 72 h period 
(58 and 61 M-scores). In addition, the OTCM is the superior aid for 48 В зревш и 
prediction (61 M-score). But a sharp degradation in speed predicton skill occurs in the 
72 h projection (69 M-score), with a corresponding drop in path prediction skill (61 
M-score) This degradation in OTCM skill is primarily associated with an increase in 
AT 2-class errors (Fig. 5.5). The 72 h CT/AT 2-class errors are highest ІП 
R(19%)/S(25%) terciles compared to the L(8%)/S(25%) These errors are consistent 
with systematic errors at 72 h where a westward bias was also observed. The reason 
for this bias may be errors in G [O forecasts on recurving storms, where the failure 
to match the right-turning motion causes negative SX errors (leftward bias in CT). A 


corresponding fast bias at this projection would account for the 100 km SY errors. An 
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additional contribution to the bias may be associated with the pre-processing technique 
causing too rapid motion of slowly-moving cyclones. 

Steering (CY50). The poor performance of CYSO is a result of large CT/AT 
errors (Fig. 5.3). The СТ 2-class errors are highest in the (9 (0 9/5) СЕИ 
5.4) at 48 and 72 h. However, the largest CY50 errors occur in speed prediction. The 
slow bias observed at 24 h sharply increases in the 48 to 72 h period. The AT 2-class 
errors (Fig. 5.5) are highest in the fast (F) terciles. and are 25, 40 and 47% at 24, 48 
and 72 h, respectively. The corresponding slow (S) 2-class errors are only 1229 0M 
13%. These errors are also consistent with the їгепа ш (ес СҮ0 5Х75Ү рг е и 
5.2). Based on the study by Chan (1982), cyclones in the western North Pacific usually 
move to the left and faster than the 500 mb geostropnic steering flow. This behavior 
would account for the rightward/slow track bias in CY50 forecasts, and no skill in path 
or speed prediction after 24 h (Fig. 5.3). 

Analogs (REC and TOTL). The analog CT/AT errors show that the failure of 
REC and TOTL 1s primarily in the CT component, whereas the AT component 1s 
better than CLIPER (with the exception of ЁС а: 721). Тїе СТ М-5согез 10108 
analogs are in the middle and high seventies. The REC has the highest CT 2-class 
errors for storms in the left tercile. These high 2-class errors (31%) exist at allioreeams 
projections, whereas the right tercile 2-class errors are in the range of 3 to 8%. This 
right-of-track bias is consistent with the large northward trend observed in the SX/SY 
errors (Fig. 5.2) for REC. Elsberry and Peak (1986) suggest that the selection of only 
recurving analogs results in significant forecast errors on left-turning and 
straight-moving storms. This may explain why the REC aid has high M-scores (73 to 
75), and no skill in path prediction (Fig. 5.3). 

The REC 2-class AT errors fall mainly in the slow tercile (25 to 30%) in the 
48 to 72 h period. This fast bias may be a result of the faster motion present in the 
recurving analogs. Many cyclones are observed to undergo significant acceleration 
after completion of recurvature, which may contribute to the fast bias in the REC 
long-range forecasts. 

In contrast to REC, the selection of analogs from the total sample (TOTL) 
results in very high 2-class CT errors for storms in the right tercile (26%, 40% and 
49% at 24, 48 and 72 h, respectively). It appears that inclusion of both left- and 
right-turning analogs in TOTL results in a leftward track bias in CT components (Fig. 


5.4) which causes errors in forecasting recurvature. However, a high percentage. (over 


56%) of center (C) tercile forecasts are correct. Moreover, the TOTL technique also 
Шесілеев БЕШІШІ реса Гогесавіз (Бір. 5.3). The TOTL aid outperforms REC; OTCM 
and CLIPER in 24-h speed prediction, and it is the only aid with skill at 72 h (AT 
M-score of 62). The AT I- and 2-class errors are highest in the slow terciles, ranging 
from 15 to 24% for 2-class errors, and 47 to 70% for i-class errors. Corresponding 
fast tercile errors are only 3 to 8% for 2-class errors, and 31 to 40% for 1-class errors. 
Thus, it appears that the utilization of the total sample of analogs results in a bias 
towards faster speed forecasts. 
4. Summary. | 

Dynamical model (OTCM). The OTCM has the best overall performance. It 
is the superior aid in path prediction at 48 and 72 h, and speed prediction at 48 h. At 
24 h, the OTCM shows no skill in path prediction possibly due to initial positioning 
and initialization errors. A peak in performance at 48 h is followed bv a slight 
degradation in path prediction skill, and sharp reduction in speed prediction skill. This 
decline in forecast skill at 72 h may be a result of OTCM 's long-range westward, fast 
bias that causes forecast positions to be ahead and left of recurving cyclone positions. 
Furthermore, this long-range bias may be a result of overcompensation by the OTCM 
preprocessing technique due to its introduction of a persistent component into the 
model. | 

__ Analogs (REC and TOTL). REC has a significant northward track bias that 

causes large errors in forecasting left-turning and straight-moving storms. This 
northward bias is caused by the selection of only recurving analogs (REC). In 
contrast, the selection of analogs from the total sample (TOTL) results in large errors 
due to missed recurvature forecasts (westward track bias). Thus, both analogs are 
unable to forecast anomalous tracks, which is consistent with findings in previous 
mepaies. Liowever, TOTL outperforms both REC and CLIPER in speed prediction, 
and it is the only aid with skill in speed prediction at 72 h. The reason for TOTL speed 
prediction skill is probably the balance between fast and slow forecasts achieved 
through using the total analog sample, compared to the REC bias toward 
right-turning/fast-moving analogs. Therefore, the TOTL technique produces a smaller 
fast bias in long-range forecasts than the REC and OTCM aids. 

Steering (CY50). CY50 1s the best aid for 24 h path and speed prediction. 
However, it is the worst aid in the 48 to 72 h projection. A significant eastward/slow 


bias is responsible for performance degradation in the long-range projection. These 


2) 


biases are a result of western North Pacific tropical cyclone motion usually being 
faster, and to the left of 500 mb steering flow. Furthermore, without the physics of 
OTCM, or the climatology influence in the analog techniques, CY50 can not account 
for the various physical processes responsible for tropical cyclone motion (1е., 
baroclinic processes or beta-effect). 

The stratifications based on storm-related parameters of latitude, longitude, 
intensity, 12-h intensity change and size will be discussed in the following sections. 
Error measures will be examined to see if there are similar features regar iiic ни 


storm-related classification. 


B. LATITUDE 

The distribution of the initial latitudes suggests the following subsamples: north 
zone (storm latitude at or north of 17°N), central zone (between 15*N and 17°N) and 
south zone (at or south of 13°N). The CLIPER MEFE for 24, 48 and 72 h represente 
standard of comparison for objective aid MFE (Fig. 5.6): north zone (176, 394 and 
605 km), central zone (176, 386 and 618 km) and south zone (200, 466 and 707 km). 

l. Dynamical Model (OTC) 

The OTCM MFE performance (Fig. 5.6) decreases with increasing latitude, as 
the largest OTCM forecast errors occur in the northern zone. In this zone 2 ies 
shows marginal skill in the 24 to 48 h period (2%) and worse than CLIPER skill (15%) 
at the 72 h projection. The reason for this trend in the northern zone is the high 
number of recurving storms that cause large forecast errors in the 4$ to 72 h interval. 
However, 72 h performance improves with decreasing latitude. The 72 h шеап О 
skill is 10% апа 30% better than CLIPER in the central and southern 70100 
respectively. In the southern zone, cyclones are located farthest from the midlatitude 
perturbations that cause recurvature, which may be the reason why the southern zone 
shows the best OTCM performance. 

The OTCM systematic and CT/AT errors show the initial eastward;slow and 
long-range westward/fast biases seen in the unstratified sample. Systematic errors (Fig. 
5.7) for OTCM have their highest SY values in the northern zone. 11 Ше По 08 
zone, the systematic error trend shows an increasing northwestward bias with time, 
which may be a result of recurvature errors. This trend decreases and becomes 
westward in the central and southern zones, where the systematic errors are quite 


small. 
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Figure 5.6 Asin Fig. 5.1, except for latitude subsamples. 


1 


4 


—— а аа о a сос ~ _ 


(WY) чониз IVNO. 


074 оф» cee 992 оог 021 о, 0 ос! 002 ова 096- 099- 029 009 
Р Б ус ру... КЕЕ: = УБЕ ИЕШЕ а LII 































І 
«з 
= 
т 
~ 
= 
о 
! 
% о 
о 
i 1 
» 5 < e 
m 
1 2 ---4 
о 5 O, 
.9 E 
о 2 сї 
2 Uu» 
17 
to tn “С 
Бе zi 
= Uu 
ғо 
: 5 
| ж 
ща ти "3 
Р as = 
« = 
> cd 
o — 
ым 
- 
5 aS 
3-2 
U | 
— OD -- Q 
> 
(WM) HOUMA ЯУМОУ, (ня) нониз IVNOZ Ф 
ог9 o» DYL анг 002 021 о» о. oči onz- 092- 996 Ors 079 One 029 09? 09€ 097 noz 071 о, о. ог! 002- 042- HOC- OFF 029 099- с 
A 23 SUNMECI 12217. 4 Бэл элээ он gu үз i: 201 = Бүрэг үсэг эфү 219 р к ээ 2; : 
е ! о u^ 
Т т 
~ > - 
| у © © CD 
5 , У Ge 
o 
^ ° 9 
' u" & 
22 s y 
. 8 ж . [|° о 
m m 
+ ! s ° м as г < 
è e - Ф 
t e с 3 e о 
CE с] == д —— T - —————— Е=—==— 5 
шы” Ес ЕЕ) e >? œ~ 
SN ы 2-3 S - 
Қ, 4 ЇГ го U^ 
у r сі" T 4 ty = ә ГІ 
° SINOZ'IVILENSEO — [85 x T о 
У я хи 20 23 
~ О о 
P | ~ z 59 
0 (5 > LL 
2 э < x 
e` ° = 
ow 
= 
о 
r f 7 
5 МОА ПАМОМ 
5» 
ә 
о 


42 


The CT/AT M-scores (Fig. 5.8) also decrease with decreasing latitude. In the 
northern zone, the OTCM shows no skill in path prediction, and no skill in speed 
prediction beyond 36 h. As in the unstratified sample, this is caused by a high 
Eueutage of 2-class errors (Fig. A.5) at.24 h ( L, 26%; R, 23Vo ) and 72 h ( L, 2475; 
R, 40% ). A similar trend occurs in 2-class AT errors (Fig. A.6) , with a high number 
of fast and slow tercile errors at 24 and 72 h( S, 38%; F, 17% at 72h). Thus, about 
twice as many large errors in OTCM 72 h forecasts occur on right-turning and;or 
fast-moving than left-turning and/or slow moving stonns in OTCM 72 h forecasts. 
This would correspond to the observed northwestward trend in the systematic errors 
(Fig. 5.7). Chan et al. (1986) found a similar trend in skill for the NTCM, and also 
attributed this trend to errors in predicting the recuvature process, especially in the 
higher latitudes (north zone). 

As the numbers of nght-turning and recurving storms decrease with latitude, 
50 00 ІПһе 2-сіа55 AT/CT errors. In the southern zone, there are no 2-class errors in 48 
and 72 h CT components (Fig. A.1), and a reduction in AT 2-class errors (Fig. 4.2) at 
EM S. 21v» P; .67» ) Therefore, the OTCM provides better path (36 to 48 
M -scores) and speed prediction ( 55 to 63 ) performance in the southern zone. 

2. Analogs (REC and TOTL) 

эг гс по (Ї brand CI/AT errors are consistent 
with the performance trends found in the unstratified sample. As in the OTCM, the 
analogs have increasingly lower M-scores with decreasing latitude (Fig. 5.8). The REC 
апа TOTL aids have no skill in path prediction in the northern zone, and TOTL is the 
only aid with some skill in speed prediction at 72 h (65 M-score). The poor 
performance in AT forecasting is a result of 2-class errors in the slow terciles of 36 to 
що оапа 26 to 52% for REC and TOTL, respectively. In CT forecasting, REC has a 
large number of 1- and 2-class errors. As in the unstratified sample, the 2-class errors 
Ши КЕС fall mainly in the left tercile (Fig. A.5). These results imply that the REC 
forecasts in the northern zone, which includes a large number of recurving cases, are 
EUMKely to be east, and ahead of the storm tracks. In contrast to REC, the TOTL 
aid has extremely high 2-class CT errors that reach a total of 32 % at 72 h, with the 
Beeority falling in the right tercile ( L, 2%; R, 93% ). Thus, the TOTL correctly 
forecasts 86% of the left-turning storms and 0% of the right-turning storms in the 
northern zone. These results are consistent with the systematic error results, where the 


largest TOTL westward bias occurs in the northern zone (Fig. 5.7). 
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As in Fig. 5.3, except for latitude subsamples. 


Figure 5.8 
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As CT/AT errors decrease with latitude, a reduction is seen in CT M-scores 
from 80 to 100 in the northern zone to 57 - 60 in the southern zone. The best analog 
aid performance occurs in the southern zone. Both analogs have path prediction skill at 
72 h. Skill in speed prediction is demonstrated at all forecast periods, with. TOTL 
outperforming all aids by 72 h (Fig. 5.8). 

3. Steering (CY50) 

The CY50 aid mean error performance (Fig. 5.6) shows an opposing trend in 
comparison to other aids by showing improvement in skill with increasing latitude. In 
the southern zone, CY50 shows skill only at 24 h (marginal), whereas no skill is 
demonstrated in the central zone. In the northern zone CYS0 is 20% and 10% better 
ШІП СГІРЕК ас 24 апа 48 h, repsectively. No skill is evident in the north zone 72 h 
forecasts. 

а Wnstratiicd saiiple, © YS0 systematic (Fig. 5.7) and CT/AT errors 
show a large southeastward (rightward)/slow bias in all latitude zones. Although CY50 
is the only aid with path prediction skill in the northern zone (Fig. 5.8), a sharp decline 
in the CT/AT M-scores with time occurs in all latitude subsamples. In the central 
zone, l- and 2-class errors increase in all tercile categories, which results in a no skill 
performance in path and speed prediction (Figs. A.3 and A.4). Due to the persistent 
nature of storms in the southern zone, CY50-has its best AT M-score (Fig. 5.8) 
performance (50 at 24 h, and 65 at 72 h), while short-term skill is demonstrated in path 
prediction (57 M-score at 24 h). The rightward/slow bias seen in the central and 
northern subsamples is still present in the southern zone and causes a sharp decline in 
long-range path and speed prediction performance. 

4. Guidance Summary 

Consistent with previous studies (Jarrell et al., 1978; Neumann and Pelissier, 
1981b; and Thompson et al., 1981), the largest forecast errors are found in the higher 
latitudes due to recurving storms. The long-range westward biases of OTCM and 
TOTL, and the northward bias of REC, are responsible for these recurvature errors in 
the northern zone. Thus, the only aid to have path prediction skill in the northern 
meme is the CY50. The CY50 steering aid does well in path prediction skill in the 
northern zone because the steering flow usually takes on an increasingly westerly 
direction as the storm moves north of the subtropical ridge. However, the slow bias in 
СҮ50 gives it the worse long-range speed performance of any objective aid. 


Improven:ent in OTCM and analog aid performance is observed with decreasing 
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latitude. In the central and southern zones, the OTCM and TOTL become the best 
aids for long-range path and speed prediction, respectively, while CY50 is the worse | 
overall performing aid. The following guidance is provided for the latitude sample: 


1) North Zone (latitude > 17? N). Path "Q CY50 at 24, A8 amd 2E 
Speed prediction- OTCM at 24 h, CLIPER at 48 h, and TOTL аа Да 


2) Central Zone (between 13°N and 17°N). Path mue DN CLIPER at 24 
T a and ДЕ h. Speed prediction- CLIPER at 24 h, REC at 48 
Ма ТЕ вам 


3) South Zone С < 13*N ). Path prediction- OTCM at 24, 48 and 72 h. Speed 
prediction- CY50 at 24 1 1 . OTCM at 4$ h and TOTL at 72 h. 


h and 
h and 


с+ ct 


C. БОМОГГОрЕ 

Based on the initial longitude, the objective aid forecasts are divided into three 
subsamples: western area (longitude at or west of 129°E), middle area (between 129° 
and 140°E) and eastern area (at or east of 140°E). The CLIPER MFE for 24, 48 and 
72 h are the standard of comparison (Fig. 5.9): western area (147, 352 and 579 km), 
middle area (188, 395 and 596 km) and eastern area (220, 499 and 763 km). 

1, Dynamical Model (OTCMI) 

The MFE variation with longitude (Fig. 5.9) indicates that the OTCM aid has 
the worst and best performances in the western and eastern areas, respectively. 
Although the western area 15 relatively data rich compared to the other areas, it 1s also 
the most complex to forecast due to the presence of large land masses (і.е., the 
Philippines and Taiwan). Unless they originated in the South China Sea, cyclones that 
reach this area are well-developed systems that have failed to recurve. 

The middle area has both westward-moving and recurving storms. The 
OTCM MFE skill tn this area is 15% and 10% Бейег Іһап СІЛРЕК аг 45 апа 7040 
respectively. However, the best OTCM peformance occurs in the eastern area where 
the 72 h skill remains at 15% better than CLIPER. The reasons for the ditiercmess 
between middle and eastern area may be: 1) the greater variability of cvclone motion 
in the middle area; and 2) the measure of skill (CLIPER) changes so dramatically that 
OTCM may not actually be that much better in the eastern zone compared to the 
middle zone. 

The OTCM systematic errors (Fig. 5.10) and CT/AT errors (Fig. 52D MD 
the same long-range westward/fast bias seen in previous samples. Consistent with mean 
error skill, the OTCM has improved CT/AT M-score variations with longitude. In the 


western area, a large number of 2-class errors (Fig. A.7) occur at 72 h ( L, 19%; R, 
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Figure 5.9 Asin Fig. 5.1, except for longitude subsamples. 
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Figure 5.10 As in Fig. 5.2, except for longitude subsamples. 
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24% ). However, these 2-class errors decrease in the eastern area. In the middle area, 
the OTCM has the best 48 h path skill performance, but shows no skill at 72 h because 
of recurvature errors ( L, 10%; R, 35% ). [n speed prediction, the OmU D skill 
at all forecast projections. The overall best OTCM performance occurs in the eastern 
area where most cyclones are westward movers (anomalous tracks do occur at the 
higher latitudes in this area). The OTCM path prediction skill (Fig. A.11) shows no 
decline at 72 h due to a low number of 2-class errors ( L, 0%; R, 3% ). 100888 
prediction skill for the OTCM declines at 72 h, although the 2-class errors (Fig. A.12) 
аге тедисей ( 5 18 о КЕ on). 

In contrast to the above findings for the OTCM, Chan et al. (1986) found the 
lowest NTCM CTI Mv-scores in the western area subsample. However, they did find a 
similar leftward bias in the NICM 48 to 72 h forecasts which they attributed to the 
failure to predict recurvature. Furthermore, the NITCM had a rightward bias at 24 h 
only in the eastern area, whereas the OTCM has a consistent rightward bias at 24 h in 
all samples discussed thus far. 

2. Analogs (REC and ГОТ.) 

Unlike the OTCM model, the analogs do not show any long-range skill in the 
middle area (Fig. 5.9). The reason for this behavior may be their respective biases, or 
the dramatic change in the measure of skill (CLIPER) between longitude subsamples. 
The mixture of westward-moving and recurving storms in the middle area can cause 
large REC and TOTL forecast errors as a result of their northward and westward 
biases, respectively. However, the analog aids show improvement ( 5 to 10% better 
than CLIPER ) in the eastern area where cyclone motion is more persistent. 

CT/AT M-score variations with longitude show poor analog aid path 
prediction skill in all areas, and superior speed prediction skill in the eastern area (Fig. 
5.11). In the western area, CLIPER outperforms the analogs at 24 and 72 h, whereas 
TOTL has the best CT skill of any aid at 48 h (60 M-score). КЕС апа ТОТ sho m 
skill in speed prediction after 24 h (64 M-score at 24 h). The 72 h rightward bias of 
REC ( L, 56%; R, 13% ) and leftward bias of TOTL ( L, 399; R; 7996 ) canseg 008 
errors on failed-recurving and recurving cyclones, respectively. Furthermore, the fast 
bias exhibited by both aids results in no skill in the long-range speed forecasts (Fig. 
A.8). 

In the eastern area, the persistent cyclone motion results in path prediction 
skill at 48 h (64 M-scores) and 72 h (REC M-score of 64). Both analog aids show 
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superior long-range skill in speed prediction, with TOTL as the best aid at 48 and 72 h 
(50 M-scores). During this period; REC and TOTL AT l-class errors are highest in 
the slow tercile ( REC, 58 - 92%; TOTL, 53-76% ). The corresponding range of AT 
2-class errors is only 0.9 to 5% for both aids (Fig. A.12). 
3. Steering (CY50) 
The CYSO aid has the worst mean error skill of any aid (Fig. 5.9). The only 
skill shown by this aid in the longitude sample occurs in the middle and eastern area 24 
EN cust periods (10 and 5% better than CLIPER, respectively). Ihe CY50 has no 
skill in speed prediction beyond 24 h in any longitude subsample (Fig. 5.11). 
Futhermore, CY50 has no path prediction skill beyond 24 h in the western and eastern 
Ec However, QYS50 performs well in path prediction in the middle area. In the 
middle area, CYSO outperforms all aids in CT skill at 24 and 72 h (60 M-scores). 
4. Guidance summary 
CLIPER outperforms all objective aids in the western area. In the western 
area, the benefit of data availability appears to be outweighed by additional complexity 
such as cyclone interaction with terrain. However, objective aid performance improves 
with increasing east longitude. In the middle and eastern areas, the OTCM has the best 
performance due to small systematic errors, and skill in both path and speed 
prediction. The REC and TOTL analogs also improve with increasing east longitude. 
In the-middle and eastern area, the analogs have the best skill in speed prediction. 
However, no path prediction skill is evident in the middle area. The middle area has 
both recurving and westward-moving storms. The northeastward and westward biases 
of REC and TOTL are responsible for large errors on westward moving and recurving 
Eus respectively. In the eastern area, the persistence in tropical cyclone motion 
reduces errors as a result of individual aid biases. The following forecasting guidance is 
provided for the longitude stratification: 
1) АИА 222 12 uo d at 24 D TOTL at 43 
RD E х z h, peed prediction- (КГ КОРА о Ота 24. and 
2) Middle area (between 129°E and 140°E). Path prediction- CY50 at 24 and 72 h 
оем at 48 h. Speed prediction- TOTL at 24 h and OTCM at 48 and 72 


3) Eastern area ( > 227 Path prediction- CY50 at 24 h and OTCM at 48 and 
72 В. Speed prediction- CY50 at 24 h and TOTL at 48 and 72 h. 


D. INTENSIFY 

The intensity is.the estimated maximum sustained wind at warning time. The 
distribution of the sample based on initial intensity gives the following subsamples: 
Weak (< 55 kt), moderate (between 55 kt and 90 kt) and intense (^ 90 kt) ne 
CLIPER MFE standard of comparison for 24, 48 and 72 h objective aid MFE (Figs 
5.12) is as follows: weak (210, 450 and 666 km), moderate (184, 415 and 643 km) and 
intense (159, 391 andado Kin): 

1, Dynamical Mode: (OTC) 

The mean errors as a function of intensity (Fig. 5.12) indicate that the Omm 
performs best on cyclones of moderate intensity, and 1s less accurate for intense storms. 
No skill is evident in the short-term OTCM forecasts of weak and intense cyclones, 
although the weak subsample displays the best 72-h performance. These errors іп the 
weak intensity subsample are probably a result of the difficulty in estimating the initial 
position of ill-defined, weak cyclones. Furthermore, these errors may be a result of tne 
deep tropospheric bogus storm in the OTCM for all cases regardless of actual intensity. 

The systematic errors (Fig. 5.13) are smallest in the moderate subsainple, 
which accounts for the good performance of the OTCM in this category. The weak 
subsample has the largest initial SX/SY errors, which is consistent with errors caused 
by initial positioning, whereas a long-range northwestward bias in the intense category 
is indicative of recurvature forecast errors. The NICM (Chan et al., 1986) also shiome 
a growing westward bias for intense storms. This NTCM trend was similarly attributed 
to the failure of the NTCM to predict recurvature of the intense cyclones. 

The CT/AT error components (Fig. 5.14) also show that the best OTCM 
performance occurs with cyclones of moderate intensity. For these cvclones, OTCM 15 
superior to the other aids in path prediction, and demonstrates skill in speed prediction 
in all forecast intervals. However, no significant skill is shown in speed prediction for 
weak cyclones. The 2-class AT errors (Fig. A.14) suggest a large slow bias (F, 35%) at’ 
24 and 48 h , while 1- and 2-class errors at 72 h suggest a fast bias. As discussed in the 
previous stratifications, this speed prediction trend causes OTCM forecast positions to 
be ahead of actual storm track. However, the mean error performance (Fig. 5.14) in 
the weak intensity subsample (10% better than CLIPER) indicates that these speed 
errors do not offset completely the CT prediction skill. 

In the intense subsample, the OTCM has path prediction skill only at 48 h, 


whereas speed prediction skill exists at all forecast periods. In this subsample, the 1- 
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Figure 5.12. As in Fig. 5.1, except for intensity subsample. 
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As in Fig. 5.2, except for intensity subsamples. 
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except for intensit 


Коше та A's in Fig. 5.3; 


and 2-class AT errors at 72 h show a leftward track bias. A similar, but smaller 
leftward bias is also present in the moderate subsample (mostly 1-class errors). The 
best performance for the NTCM also occurs in the medium intensity subsample (Chan 
et al., 1986). The NTCM CT errors are biased to the right of the бепан 
weak group, evenly distributed for the medium group, and left-of-track for the intense 
subsample. In all cases, the OTCM has an initial right-of-track bias followed bv a 
long-range left-of-track bias. 
2. Analogs (REC and TOTL) 

The REC aid shows no MFE skill (Fig. 5.12) in the weak intensity subsample. 
However, the REC performance improves with increasing cyclone intensity. For 
moderate intensity cyclones, REC has marginal short-term skill, and no long-range 
skill. Although still marginal, the REC shows some improvement (1 to 2%) in 48 h 
forecasts of intense cyclones. This small improvement in REC skill with increasing 
cyclone intensity may be due to an increase in the number of recurving cyclones with 
intensity. 

The REC systematic (Fig. 5.13) and CT;AT error trends are consistent чан 
those in previous samples ( northeastward bias). The CT/AT M-scores for REC (Fig. 
5.14) indicate no skill in path prediction for weak and intense cyclones, and path 
prediction skill only at 24 h for moderate intensity cyclones. As in previous samples, 
REC has a high percentage of 2-class errors in the left (L) tercile (Fis. A.17)) PENES 
AT components, the REC aid shows skill in the weak and moderate intensity 
subsamples, with the best performance in the moderate subsample. The intense 
category has no skill in speed prediction due to a high percentage of 2-class errors in 
the slow (S) tercile (Fig. A.18). 

In contrast to REC, TOTL performs best (Fig. 5.12) on moderate intensumm 
cyclones, and has less skill on intense cyclones. As in the previous TOTL samples, 
systematic errors (Fig. 5.13) show а westward bias. In the intensity sample, this 
westward bias increases with increasing cvclone intensity and may be indicative of an 
increase in the number of recurving storms with increasing storm intensity. 

The TOTL CT/AT M-scores (Fig. 5.14) show no speed or path prediction skill 
for mtense cyclones. The 2-class CT errors (Fig. A.17) are consistent with systematic 
errors (Fig. 5.13) in that they show a large left-of-track (westward) bias in the intense 
cyclone subsample at all forecast periods. A corresponding fast bias is also indicated 
by AT 2-class errors (Fig. A.18). 
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3. Steering (CY50) 

The CY50 aid has no long-range skill in the intensity sample (Fig. END 
However, some short-term skill is shown in the weak and intense subsamples. As in 
previous samples, systematic errors (Fig. 5.13) show a large southeastward trend. The 
CT/AT errors also indicate that CY50 has an increasing right-of-track bias with 
increasing cyclone intensity. This is consistent with a study by Chan (1982) in which 
cyclone movement was increasingly to the left of the 500 mb steering flow with 
increasing cvclone intensity. Furthermore, cyclone speed was usually faster than the 
500 mb flow. The lowest number of 2-class CT/AT errors are in the weak intensity 
subsample where CY50 has short-term CT and AT skill (Figs. A.17 and A.18). 
However, the CY50 rightward/slow track bias makes it the worst overall aid in the 
intensity stratification. 

4. Guidance Summary 

The OTCM aid performs well in predicting the turning motion of weak 
cyclones. However, the OTCM long-range fast bias causes errors in speed prediction. 
Thus, the OTCM can only demonstrate AT skill at 48 h in the weak subsample. The 
best OTCM performance occurs in the medium intensity subsample where the aid has 
speed and path prediction skill at all forecast periods. In the intense subsample, 
OTCM has path prediction skill only at 48 h as a result of a long-range leftward track 
Es — 

The REC and TOTL analogs have superior skill in speed prediction in the 
weak and medium intensity subsamples, but no path prediction skill (with the 
exception of TOTL at 48 h). The northeastward bias in REC is responsible for errors 
in the weak and medium subsamples, whereas a westward bias in TOTL causes similar 
results. For intense storms, the analog aids show no skill in either path or speed 
prediction. The fast biases in both aids appear responsible for their lack of AT skill for 
imanense cyclones. 

The CY50 aid has no speed or path prediction skill beyond 24 h, except in the 
medium subsample ( path skill at 48 h), because of its large southeastward bias. CY50 
forecasts are usually slower and right of actual storm position for most categories of 
cyclone motion. The slow bias, rather than the rightward bias, is responsible for poor 
СУ 50 performance. 


|) pacer 20 < 551 4 )}._ Path prediction- CY50 a 2 Dele Vigor О at 
48 at 72h. Speed prediction- CY50 at 24 h and TOTL at 48 and 


; 


2) Moderate intensity ( between 55 and 90 kt ). Path prediction-- OTCM, ВЕС, 
TOTL or CYS50 at 24 h and OTCM at 48 and 72 h. Speed prediction- LOTE at 
24 апа 72 h, and REC and TOTL at 48 h; and 


3) Intense ( 7, 90 kt. ). Path prediction- CY50 at 24 h, OTCM at 48 Б апа 
CLIPER at 72 h. Speed prediction- OTCM at 24, 48 and 72 h. 


E. 12-HOUR INTENSITY CHANGE 
The 12-h intensity changes (IC) are divided into the following subsamples: weakening 
(IC < 0 kt), intensifying (between 0 and 5 kt) and rapidly intensifving (1C KODE 
The СПРЕК МЕЕ for 24, 48 and 72 h represent the standard of comparison for 
objective aid MFE (Fig. 5.15): weakening ( 160, 390 and 675 km), intensifying (197, 
443 and 640 km) and rapidly intensifying (179, 411 and 647 km). 

1. Dynamical Model (OTC) 

The OTCM model worst and best mean error performances (Fig. 5.15) occur 
in the weakening and rapidly intensifving subsamples, respectively. The OTCM has no 
skill in the weakening group. Storms generally intensify rapidly at relatively low 
latitudes and weaken as they move to high latitudes. Furthermore, weakening storms 
are either approaching landfall or undergoing upper-level shear and recurvature. In the 
intensifying and rapidly intensifying subsamples, the OTCM has peaks in skill relative 
to CLIPER at 48 h of 15 and 1895, respectively, while фе 72-6 5КШ 15 10%. Ша 
improved performance for intensifying and rapidly intensifying cyclones may be a result 
of their better definition, thereby reducing initial positioning errors. 

The OTCM systematic (Fig. 5.16) and CT/AT errors indicate the presence of a 
westward bias as in the distribution of previous samples. Similar to the NTCM 
performance (Chan et al., 1986), the best OTCM performance 1s on rapidly intensifying 
storms (Fig. 5.17). In the CT components, the best OTCM perform K m 
intensifying storms. As in the NTCM, the worst OTCM CT forecastsare aso ШЫ 
with weakening cyclones. In the weakening subsample, there is no OTCM CT skill 
beyond 24 h (Fig. 5.17). Furthermore, both models have a high percentage of 2-class 
CT errors for right-turning storms (Figs. А.19, А.2| ап А.23). Могеоуег, Сай Ее 
(1986) found the worst NTCM forecasts for the AT component in the weakening 
category, whereas the OTCM AT skill occurs at 48 h for weakening storms and 24 and 
48 for intensifying storms. For these weakening storms, the OTCM correctly forecasts 
57 to 74% of the slow moving storms compared to only 34 to 48% for fast moving 


storms. In previous stratifications, the OTCM has a long-range fast bias that reduces 


skill in AT prediction at 72 h. In contrast to the NTCM, which has a slow bias in all 
intensity change subsamples, the OTCM has some AT skill, especially in the rapidly 
intensifying sample as a result of a reduction in 1- and 2- class errors. The 2-class AT 
errors in the slow tercile are primarily responsible for this long-range fast bias ( S, 
27%; F,16% ) in the intensifying sample. 

In the rapidly intensifying sample, small and equally balanced right and left 
Mereie 2-class errors are the reason for the consistent OTCM long-range path 
prediction performance (61 M-score at 48 and 72 h). In this sample, the OTCM 
characteristic “V” shape in CT prediction skill at 24, 48 and 72 h is due to a 
short-range slow bias (2-class errors of S, 2%; F, 29% at 24 h) and the long-range fast 
bias (2-class errors оГ 5, 31%; Е, 9%). However, speed prediction skill is shown in all 
forecast periods. 

2. Analogs (REC and TOTL) 

As in the OTCM, the analog aids have no mean error skill in the weakening 
group and their performance improves in the intensifying subsample. In the 
ШЕШ пе group, TOTL outperforms (10 % better than CLIPER) REC (3 % ). 
However, no long-range skill in CT or AT is demonstrated by either aid for intensifying 
storms. In the rapidly intensifying group, REC and TOTL are only 4 % better than 
CLIPER in the 36 to 48 h period, and have no skill at 72 М. 

шиг ne Cand POL systematic (Fig. 5.16) and CT/AT error trends are similar 
to those scen previously in other stratifications. In all cases, the analog aids show no 
long-range path prediction skill (Fig. 5.17). A similar performance occurs in spced 
prediction. The only AT skill for weakening cyclones is seen in the TOTL aid. 

3. Steering (CY50) 

‘the only demonstrated CY50 skill is in the 24 h period of all subsamples (Fig. 
ENS Ihe CY50 systematic errors (Fig. 5.16) again suggest that the characteristic 
southeastward bias in CY50 is responsible for the poor mean error performance. In 
the CI components, the CY50 is the best aid for weakening cyclones, and also 
performs well in the intensifying subsample (Fig. 5.17). The CY50 has no CT skill for 
rapidly intensifying storms. In all cases, С\50 раз а steady decline in CT skill 
throughout the forecast period. However, CT/AT M-scores (Fig. 5.17) suggest that 
errors in the speed forecast ( particularly the slow bias ) are responsible for the overall 


poor mean error performance. 
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except for 12-h intensity change subsamples. 
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Figure 5.16 As in Fig. 5.2, except for 12-h intensity change subsamples. 
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4. Guidance Summary 

The best OTCM performance is on intensifying and rapidly intensifying 
storms, whereas the worst performance is associated with weakening cyclones. The 
weakening storms usually occur at relatively high latitudes, and are generally 
undergoing landfall or recurvature. 

The analog aids appear insensitive to the 12-h intensity change. Both REC 
and TOTL perform poorly in all cases due to their respective northward/fast and 
westward/fast biases. Finallv, the CY50 aid 15 the only aid with CT skili in the 
weakening subsample. The CY50 also has CT skill for intensifying storms, but has no 
skill for rapidly intensifying storms. The rightward/slow bias in CY50 1s responsible for 
the decline in CT skill with time and the lack of AT skill in all intensity change 
subsamples. 


1} Weakening cyclones (12-n-IC < 0 o кк. rediction- CY 50 at 24, 48 and 72 h. 
Speed prediction- CY350 at 24 h, OTCM at 4 $h Оо 201 


2) x ИА -Л [C between 0 and 5 kr). Рай EU CY50 at 24 h and 
ey Yat 48 and 72h. Speed prediction- REC at 24 and 48 h and TOTL at 72 
; and 
А 4h 


3) Rapidly intensifving ( nonc I n Path prediction- C 


12111 
ЗОаг222 mn aie ©] C Mea 


at 48 and 72 В. Speed prediction- 

КО SIZE 

Шлонгасив К) of 15 m/s winds is one measure of the size of a tropical cyclone. 
Meese stOrm sizes can be divided into three subsamples: small cyclones (R < 135 n 
mi), medium cyclones (between 135 and 220 n mi) and large cyclones (R > 220 n mi). 
The CLIPER MFE for 24, 48 and 72 h represents the standard of comparison for the 
objective aid MFE (Fig. 5.18): small cyclones (205, 428 and 660 km), medium cyclones 
(177, 425 and 663 km) and large cyclones (174, 386 and 594 km). 

1. Dynamical Model (OTCM) 

For small cyclones, the OTCM short-term skill is about 15% worse than 
CLIPER, while long-range skill is 5% better than CLIPER. This OTCM short-term 
skill for small cyclones is the worst of any aid in the three subsamples. The reason 
may lie in the problem of locating the initial position of small cyclones and the bogus 
vortex in the OTCM may be inappropriate for a small cyclone. An improvement is 
seen for medium and large cyclones. The OTCM long-range skill is 10% better than 
CLIPER for medium cyclones, and 15 and 5% better than CLIPER for large cyclones 


at 48 and 72 h. The decline in skill at 72 h for large cyclones as compared to 





X WORSE THAN CUPER 


7. BEITER THAN CUPER 





SMALL CYCLONES 2 MEDIUM CYCLONES 





LARGE CYCLONES 







X WORSE THAN CLIPER 


X BETTER THAN CLIPER 


Figure 5.18 As in Fig. 5.1, except for size subsamples. 
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consistent medium-size cyclone performance may be a result of recurvature errors, 
because cyclones usually reach their greatest size prior to recurvature (Merrill, 1982). 

The OTCM systematic (Fie. 3-19) and C1/AT error (Fig. 5.20) trends are 
similar to those in previous stratifications. In all cases, the OTCM has CT skill 
beyond 24 h. As in the NTCM (Chan et al, 1986), the OTCM performance for СТ 
prediction is slightly better for small cyclones. Unlike the OTCM, the NTCM has no 
Moperent skill over CLIPER in forecasting the CT components for large cyclones. 
Overall, both the NTCM and OTCM show a leftward track bias which may be 
responsible for long-range forecast errors. 

In the AT component (Fig. 5.20), the OTCM has skill only at 24 and 48 h for 
all sizes of cyclones. Whereas the NTCM has a slow bias in all cases, the OTCM has a 
fast bias that decreases with increasing cyclone size (Figs. A.26, A.28 and A.50). 

The relatively good OTCM performance on large cyclones compared to the 
the poor NICM performance may indicate problems with the “nested” grid in the 
NICM. Chan et al. (1986) suggests that the large cyclones may lie outside the inner 
emcee! the NICM. 

2. Analogs (REC and TOTL) 

The TOTL analog outperforms REC in the small and medium size groups 
ШЭ 18). In the small subsample, REC has no mean error skill, whereas TOTL 15 
only 3% better than CLIPER in the 48 to 72 h period (no skill at 24 h). Both analogs 
improve in performance in the medium subsample, for which the skill of REC 15 
Enpxableto CLIPER and TOTL 15 5 to 10% better than CLIPER in all forecast 
intervals. However, REC clearly outperforms TOTL in the large cyclone subsample, 
muenoueh the REC has no skill at 72 h. 

( 082 тас error trend (Tis. 5.19) is consistent with MFE 
performance. The TOTL SX errors increase with increasing storm size which results in 
НООТ! MIE performance for large cyclones. In contrast to TOTL, REC has 
large SY errors in all size subsamples. 

The analog aids have CT skill only for medium size cyclones (Fig. 5.20). For 
оС size cyclones, the REC aid outperforms the other atds in 48 - 72 h path 
Шашеноп Skill, апй ТОТ. Паз (Бе best 24 h CT prediction skill As in previous 
stratifications, the northward bias in REC results in the no-skill CT performance for 
small and large cyclones (Figs. A.25, A.27 and A.29). 
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Ши snc. except for size subsamples. 
6 


In the AT components, only the TOTL aid has long-range skill for small and 
medium size cyclones. The CLIPER aid outperforms all aids in AT skill for large 
cyclones at 72 h. The REC aid has short-term AT skill only at 24 and 48 h for small 
cvclones, and no speed prediction skill in the other subsamples. The characteristic fast 
bias in REC is responsible for the poor AT performance in the medium and large 
subsamples, whereas an uncharacteristic slow bias in TOTL (Fig. A.30) results in a 
no-skill AT performance for large cyclones. 

3. Steering (CY50) 

The CY50 aid shows no mean error skill (Fig. 5.18) in the medium and large 
cyclone groups. In the small group, CY50 has skill only in the 24 Б (1970) 1088 MN 
(10%) period. The CY50 systematic error trends (Fig. 5.19) have a southeastwvamdg ы 
(seen in previous samples) that increases with increasing cyclone size. The CT/AT 
M-scores show that CY50 has CT prediction skill for oniy small cvclones and AT 
prediction skiil at 24 h for small and medium cyclones (Fig. 5.20). As in previous 
stratifications, an excessive slow bias in CY50 1s the primarv cause of forecast errors, 
with errors also attributed to the CY50 rightward track bias. 

4. Guidance Summary 

The OTCM has path prediction skill in all subsamples. In speed prediction, 
the OTCM has no long-range skill because of a fast bias. The analog aids have no CT 
skill for-small and large cyclones as a result of their respective biases. Момемеш 06 
REC outperforms the other aids in path prediction for medium size storms, whereas 
the TOTL aid has the the best long-range AT skill of any aid for small and medium 
storms. Finally, the CY50 has no AT or CT skill outside of path prediction skill for 
small cyclones because of a rightward/slow bias. 


l) Small cyclones ( R < 133 n mi )._Path prediction- CY50 at 24 h and OICM at 
48 and 72 h Speed prediction- CY50 at 24h, REC at 48 hand TOTL at 72 h; 

2) Medium ( R between 135_and 220 n mi ). Path prediction- TOTL at 24 h and 
REC at 48 and 72 h. Speed prediction- CY50 at 24 h, OTCM at 48 h and 
ТОС 2 02917210 


3) Large ( R » 220 n mi ). Path prediction- CY50 at 24 h and OTCM at 48 and 
72 h. Speed prediction- VOTL at 24 h and OTCM at 48 and 72 h. | 
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VI. SYNOPTIC PARAMETER RESULTS 


Objective aid performance in terms of synoptic parameters 1s presented in this 
chapter. A brief description of the unstratified (total) sample is followed Бу а 
discussion of the four synoptic subgroups. Error statistics for the unstratified sample 
are discussed in the following order: 1) mean forecast errors, 2) systematic errors, and 
3) CT/AT errors. The synoptic subgroups are as described in Chapter III: 


l) И, > 0 апа У250-2 > 0 (low-level easterlies and upper-level trough to the 
north); 


2) шан < 0 апа У250-2 > 0 (low-level westerltes and upper-level trough to the 
north); 


3) U700-2 » O and,V250-2 « 0 (Iow-level easterlies and upper-level ridge to the 
north) and 


4) E < 0 and V250-2 < 0 (low-level westerlies and upper-level ridge to the 
nort 


A performance summary is given at the end of this chapter. The four synoptic 


subgroup flow patterns are illustrated in Fig. 6.1. 


А. UNSTRATIFIED SYNOPTIC SAMPLE 

вое @mective aid mean error trends (Fig. 6.2) are almost identical to those seen 
in the storm-related parameters (Fig. 5.1). The CY50 aid is the only exception, as it 
has a 10% reduction in overall skill. Although both storm-related and synoptic 
parameter data are taken from warnings issued by JTWC during the 1981 то 1985 
seasons, the reduction to 181 (from 356) homogeneous cases has apparently caused the 
Шо тейпспоп іп СҮ50 skill The MFE for CLIPER tn the synoptic total sample are 
183, 418 and 659 km, which are essentially identical to those for the storm-related 
sample (183, 418 and 639 km). Furthermore, systematic errors trends (Fig. 6.3) are 
also similar to those in the storm-related sample (Fig. 5.2). The CT/AT M-score 
variations with time (Fig. 6.4) have only a small reduction in skill and no change in 
ШЕШ сопіратей to the storm-related sample (Fig. 5.3). The CY50 aid is the only 
exception with no skill in short-term path prediction. Therefore, few significant 
differences exist between the storm-related and synoptic parameter unstratified samples. 

The stratifications (subgroups) based on synoptic parameters will be discussed in 
the following sections. Error measurements will be examined to see if there are similar 


features regardless of svnoptic-parameter classification. 
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REPRODUCED AT GOVERNMENT EXPENSE 
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Figure 6.2. Mean forecast errors relative to corresponding  . 
CLIPER forecasts for the poral synoptic sample of 181 objective aid 
orecasts. 
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Figure 6.4 Time variations of the CT/AT M-scores for the total 
synoptic sample of 181 objective aid forecasts. 
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В. 700 MB EASTERLIES AND 250 Vib TROUGH IO  Н O D 

The CLIPER MFE for 24, 48 and 72 h (172, 418 and 673 km) cr це 
standard of comparision. The synoptic flow pattern for subgroup 1 is provided in Fig. 
6.la. Higher zonal translational speeds are observed in subgroup | cyclones compared 
to subgroups 2 and 4 (Peak et al., 1986). 

1. Dynamical Model (QTCM) 

іп comparison with the performance in the total sample, the OTCM model in 
this synoptic suogroup (Fig. 6.5) shows a 15 and 10% reduction in short- and 
long-range skill respectively, relative to the total sample of OTCM forecasts. 
Furthermore, this OTCM MFE performance 1s the worst of the four subgroups with 12 
to.24 h period skill 25? worse tham CETDETS 

There is no significant difference in the OTCM systematic егтог сопа ни 
6.6) compared to the corresponding unstratified sample. However, the СЕ УЕ 
variation with time (Fig. 6.7) shows that OTCM forecasts in this synoptic subgroup 
have no significant skill in path prediction. The 2-class CT errors (Fig. 6.8) are higher 
in this subgroup compared to the total sample. The OTCM does not perform as well 
on left-turning storms at 24 h, and right-turning and straight-moving storms at 48 and 
72 В. In this subgroup, the low-level easterlies tend to advect the cyclone toward the 
upper-level ridge located to the west (Fig. 6.la) which inhibits northward meridional 
mot‘on (Peak et al., 1986). Thus, the initial nghtward track bias may result in a higher 
percentage of left tercile 2-class errors at 24 h. As the storm tracks toward the ridge, 
the pre-pzocessing technique may overcompensate for the inittal track bias and result in 
a larger leftward track bias than in the total sample. 

In speed prediction, the OTCM has a very large slow bias at 24 h that 
changes to a small fast bias at 48 and 72 h (Fig. 6.9). [tis the slow bias that appears 
to cause the poor short-term AT skill and largest short-term MFE (Fig. 6.5). The AT 
skill of the OTCM improves as the characteristic fast bias develops at 48 and 72 h. 

2. Analogs (REC and TOTL) 

The TOTL aid is the only analog method that shows any significant 
short-range skill ( 5% ) for this synoptic subgroup (Fig. 6.5) and both REC and TOIL 
have no skill at the 72 h projection (10% worse than CLIPER). АЗ ш Ш ОВ 
there are no significant differences in the subgroup 1] and unstratified sample systernatic 


error trends. 
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As in Fig. 6.2, except for subgroup 1. 
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Figure 6.6 As in Fig. 6.3, except for subgroup 1. 
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Figure 6.7 As in Fig. 6.4, except for subgroup 1. 
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The CT/AT profiles for TOTL show no skill in CT prediction (Fig. 6.7). As in 
the total sample, a leftward bias (Fig. 6.8) is responsible for the no-skil in path 
prediction. The REC still has a rightward track bias that results in no CT skill at 24 
and 72 h. However, REC performs well in path prediction at 48 h, especially on 
straight-moving storms. 

As in the total sample, the REC has no speed prediction skill (PIENE 
Unlike the total sample, REC performs poorly on both fast and slow-moving storms in 
this synoptic subgroup (Fig. 6.9) as a result of a high percentage of AT 1-class errors. 
The TOTL aid is once again the best aid for speed prediction. The characteristic fast 
bias in TOTL does well on the subgroup 1 fast-moving and moderate speed storms. 
Unlike the OTCM, the TOTL is unable to predict the long-range fast motion of these 
storms, which results in an uncharacteristic peor performance on fast-moving storms at 
72 h (Fig. 6.9). | 

3. Steering (CY350) 

The CY50 aid shows no significant skill in this subgroup (Fig. 6.5). The 
short-range skill is comparable to CLIPER, but shows a sharp decline in the 72 h 
projection ( 35 % worse than CLIPER). Furthermore, there is no significant difference 
in systematic error trend (Fig. 6.6) compared to the unstratified sample. 

However, the CY50 is one of only two aids that show CT skill at 48 h. As in 
the unstratified sample, an initial leftward track bias is replaced by a long-range 
rightward track bias (Fig. 6.8). However, the subgroup 1 biases are of a greater 


magnitude than in the unstratified sample. 


C. 700 MB WESTERLIES AND 230 MB TROUGH TO THE NORTH 

The CLIPER MFE for 24, 4$ and 72 h (192, 449 and 728 km) гергесеп ENEE 
standard of comparison. The synoptic flow pattern for subgroup 2 1s provided in Fig. 
6.16. In subgroup 2, the low-level westerly flow tends to retard storm movement 
toward the upper-level ridge to the west (Peak et al., 1986). 

1. Dynamical Modei (OTCM) 

In comparison to subgroup 1, the OTCM shows a reduction in short-range 
mean errors (Fig. 6.10) and a 5% improvement in long-range skill ( 15% better than 
CLIPER). Smaller systematic errors are responsible for this improvec periotmames 
(Fig. 6.11). Moreover, this is the only subgroup in which the OTCMO ох 


northward bias rather than the usual westward bias at longer ranges. 
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Figure 6.10 As in Fig. 6.2, except for subgroup 2. 
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The CT/AT M-score variations with. time (Fig. 6.12) show that the OTCM 
has long-range skill in both path and speed prediction. In the CT component, the 
2-class CT errors in the left tercile (right bias) decrease to zero by 72 h (Fig. 6.13), with 
an increase in 24 and 72 h CT 1-class errors compared to the total sample. Because 
the northward meridional motion 1s only slightly greater than in subgroup 1, an overall 
reduction in storm speed is observed. This reduction ш storm speed may cause the 
eduction in CT 2-class errors. 

2. Analogs (REC and TOTL) 

The REC aid has no MFE skill in this subgroup, whereas TOTL is 7 to 10% 
better than CLIPER throughout the forecast period (Fig. 6.10). The systematic error 
trend (Fig. 6.11) indicates the smallest westward TOTL bias of any subgroup, while the 
ISEC has the largest northeastward bias. 

Unlike in subgroup 1, the REC has no path prediction skill, whereas TOTL 
now has CT skill at 48 h only (Fig. 6.12). The larger rightward REC bias may be a 
result of the REC analog sample including a larger meridional translation than in 
subgroup l. This characteristic and the slower cyclone speeds may indicate a recurving 
situation in the REC analog scheme. However, the upper-level ridge and slow cyclone 
speeds may retard severe right-turning motion and result in a high percentage of 2-class 
CT errors for REC in the left tercile at 24 and 48 h (Fig. 6.13). The TOTL does well 
on the left-turning storms and poorly on nght-turning storms at 48 and 72 h. The 
return to a leftward track bias results in CT skill at 48 h. 

In AT prediction, the REC aid has no skill beyond 24 h as a result of a 
growing fast bias (Fig. 6.14). The TOTL aid has a fast bias and AT skill at 72 h. 
These results are consistent with the slower cyclone speeds found in this subgroup. 

3. Steering (CY50) 

ЕО dhas no MT E skillin this subgroup (Fig. 6.10), Short and 
long-range performance is 10 and 40% worse than CLIPER, respectively. Systematic 
ШИ 50.11) ала СТ/АТ class errors (Figs. 6.13 and 6.14) suggest that the CY50 
southeastward(rightward)/slow bias is responsible for the absence of skill in this 
subgroup. In this subgroup, the CY50 has no CT skill and no AT skill beyond 24 h 
aus. 6.12). 
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Figure 6.12 As in Fig. 6.4, except for subgroup 2. 
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Figure 6.13 As in Fig. 6.8, except for subgroup 2. 
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D. 700 MB EASTERLIES AND 250 MB RIDGE TO THE NORTH 

The CLIPER MFE for 24, 48 and 72 h (178, 413 and 675 km) represent the 
standard of comparison. The synoptic flow pattern for subgroup 3 is given in Fig. 
6.1c. In subgroup 3, the low-level easterly flow tends to advect the cyclones toward 
the upper-level trough to the west, which results in greater northward meridional 
motion than in subgroups 1 and 2 (Peak et al., 1980). 

1. Рупатісаі Модеі (ОТСМ) 

In comparison to subgroups | and 2, the OTCM shows improvement in 
long-range skill for this synoptic subgroup. The OTCM performance is 18 and 11% 
better than CLIPER at 48 and 72 h, respectively (Fig. 6.15). However, this subgroup 
also has the largest OTCM zonal errors (-360 km) and smallest meridional errors ( 10 
km) at 72 h of any subgroup (Fig. 6.16). | 

The CT/AT M-score variation with time (Fig. 6.17) shows that the OTCM has 
skill in speed and path prediction at all forecast periods. Although the AT class errors 
show the characteristic slow at 24 h and fast at 72 h biases for the OTCM (Fig. 6.19), 
the CT class errors show a left-of-track bias at all forecast projections (Fig. 6.18). 
Usually, the OTCM has a rightward track bias at 24 h, but performs well with the 
left-turning storms in this subgroup. 

As in subgroup 1, cyclones have greater zonal motion than in subgroups 2 and 
4. However, the additional northward motion in this subgroup may account for the 
leftward track bias and slight reduction in slow. bias at 24 h (Figs. 6.18 and 6.19). 

2. Analogs (REC and TOTL) 

ЈА 50 осгонр, пе REC has its best performance, while TOTL has its worst 
22015) In fact, the TOTL aid has no skill in this subgroup, while the REC is 5% 
emer than CLIPER at 48 h. In the systematic error trend (Fig. 6.16), there is no 
significant difference in TOTL compared to the unstratified sample. However, the 
REC has a significant reduction in SX errors. 

и реши Wilh tie systematic error trend, the REC 2-class CT errors 
indicate only small track biases (Fig. 6.18), whereas the TOTL 2-class CT errors have a 
large leftward track bias. Thus, the TOTL aid has no CT skill and REC has path 
prediction skill at 48 h only (Fig. 6.17). A high percentage of l-class CT errors in the 
left tercile of REC (right bias) results in no CT skill at 72 h. These performances are 


consistent with the greater northward storm motion in subgroup 3. 
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Figure 6.15 As in Fig. 6.2, except for subgroup 3. 
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Figure 6.16 As in Fig. 6.3, except for subgroup 3. 
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Figure 6.17 As in Fig. 6.4, except for subgroup 3. 
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Figure 6.18 Asin Fig. 6.8, except for subgroup 3. 
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In speed prediction, both the REC and TOTL have 24 h skill and no 48 h 
skill. A high percentage of 2-class AT errors in the slow tercile (fast bias) 1s the reason 
fete lack of skill in AT prediction at 48 h (Fig. 6.19). However, these errors 
decrease after 48 h, which results in AT skill at 72 h. 

3. Steering (CY50) 

Нэг 111: 521011 УК 0 115 subgroup (Fig. 6.15). The СТАТ 
M-score variation with time (Fig. 6.17) shows that CY50 has no skill in patn or speed 
prediction. As in previous subgroups, the growing rightward/slow bias appears 


responsible for the CY50 poor performance (Figs. 6.18 and 6.19). 


Е. 700 MB WESTERLIES AND 259 MB RIDGE TO THE NORTH 

The CLIPER MFE for 24, 48 and 72 h (184, 400 and 586 km) is the standard of 
comparison. The synoptic flow pattern for subgroup 4 is given in Fig. 6.14. In 
subgroup 4, the low-level westerlies retard westward motion although a higher 
northward translation occurs than in subgroups 1 and 2 (Peak et al., 1986). 

1. Dynamical Model (OTCM) 

The OTCM model has its best long-range mean error performance in this 
subgroup (Fig. 6.20). In contrast to the other groups, no decline is observed between 
48 and 72 h forecasts (16% better than CLIPER). In the systematic error trend (Fig. 
6.21), there is no significant difference compared to the unstratified sample of OTCM 
forecasts. 

AS In previous subgroups, an initial rightward track bias and long-range 
leitward bias (Fig. 6.23) result in poor CT performance at 24 and 72 h (Fig. 6.22). The 
OTCM has the best 48 h CT performance of any aid. There is no significant difference 
between subgroup 4 and total sample AT skill. An initial slow bias followed by a fast 
long-range bias (Fig. 6.24) results in no AT skill at 24 and 72 h. 

2. Analogs (REC and TOTL) 

Пе ке а tas по MEE skill in this subgroup, while the TOTL has 
short-range skill ( 2 - 4% ), and no long-range skill. As in subgroup 3, the REC has a 
reduction in SX errors compared to the unstratified sample, while no significant 
difference is observed in TOTL systematic error trend (Fig. 6.21). 

The CT/AT M-score variation with time (Fig. 6.22) shows that the REC and 
TOTL aids are similar to OTCM in the profile trend of their performances. As in 
previous subgroups, a large REC rightward track bias and TOTL leftward track bias 
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Figure 6.20 As in Fig. 6.2, except for subgroup 4. 
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Figure 6.21 Ás in Fig. 6.3, except for subgroup 4. 
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As in Fig. 6.4, except for subgroup 4. 
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(Fig. 6.23) results in no CT skill at 24 and 72 h for both aids. Similarly, fast biases in 
both aids (Fig. 6.24) result in no AT skill at .24 and 72 h (especially at 72 h). Thus, 
both analogs are unable to predict the possibly slower and more right-turning storms in 
subgroup 4, except at 48 h. 
3. Steering (CY50) 

The CY50 aid demonstrates no skill in this subgroup (Fig. 6.20). As in 
previous subgroups, a southeastward bias is responsible for this poor performance (Fig. 
fee) Furthermore, the CY50 bias is the largest of any subgroup. Thus, no skill is 


shown in either path or speed prediction beyond 24 h (Fig. 6.22). | 


Е. SUMMARY 

The 2 X 2 EOF synoptic classification provides a distinct set of subgroups for the 
evaluation of objective aid performance. The EOFS derived from the environmental 
wind field provide a physically realistic depiction of different synoptic conditions 
associated with tropical cyclone motion. Mode 2 of the 700 mb zonal flow indicates 
Paerdirection and strength of the zonal steering flow. Mode 2 of the 250 mb meridional 
flow describes the mid-latitude troughs and ridges to the north of the tropical cyclone. 

Subgroup 1. In this subgroup, the low-level easterlies advect the cyclone towards 
the ridge to the west which results in the lowest northward motion of any subgroup. 
The OTCM has its worst performance in this subgroup with no skill demonstrated in 
any forecast period. The only CT skill shown is by REC and CY50 at 48 h , and AT 
EB IOTE and CY50 at 24 h. There is no skill in either AT or CT prediction by 
anveaid at 72 h. 

Subgroup 2. The low-level westerlies retard the westward motion of cvclones and 
slightly increase the northward motion compared to subgroup 1. The OTCM has no 
skill at 24 h, CT and AT skill at 48 h, and only CT skill at 72 h. Both REC and TOTL 
have CT skill at 24 h. Only TOTL has CT skill at 48 h and AT skill at 72 h. The 
CY50 aid only has CT skill at 24 h. 

Subgroup 3. The low-level easterlies advect the cyclones toward the trough to the 
west which results in higher westward motion compared to subgroup 2, and greater 
northward motion compared to subgroups Iu» ТЕ ОЛЫ has its best 
performance in this subgroup with CT and AT skill at all forecast periods. The REC 
E skill at 24 h, CT skill at 48 h and no skill at 72 h. TOTL has AT skill at 24 h, 
Memckill) at 48 h and AT skill at 7/2 һ. Тһе СҮ50 has no AT or CT skill in this 


subgroup. 
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Subgroup 4. As in subgroup 2, the low-level westerlies retard the westward 
motion of cyclones. However, the northward motion is similar to subgroup 3. The 
OTCM has no skill at 24 h, CT and AT skill at 48 h and no skill at 72 h. Both the 
REC and TOTL have no skill at 24 h, ОТ and AT skill at 48 h and no skill at 72 h. 
The CY 50 has CT and AT skill at 24 h and no skill at 48 and 72 В. 
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Vil. CONCLUSIONS 


]. Summary 

The performance of four western North Pacific Ocean objective aids (OTCM, 
REC, TOTL, CY50) has been evaluated using various error statistics. Although mean 
(62485: error (МЕЕ) is useful as an absolute measure. it does not provide an 
Essessment of skill. Fherefore, the western Pacific CLIPER 1s used as a normalizer, or 
no-skill model, to provide a benchmark to measure the skills of other objective 
techniques. The MFE results show the OTCM is the best overall objective forecast 
aid, especially in the long-range forecasts. The analogs REC and TOTL show по 
significant MFE skill with respect to CLIPER in short- to mid-range forecasts, and 
usually no skill in the long-range forecast. The CY50 usually has only 24 h MFE skill. 
Because the MFE does not provide any direction information, zonal and meridional 
systematic errors are calculated as a method of introducing directionality. The 
systematic error statistics reveal distinct biases for each objective aid: 1) OTCM 
(short-range northeastward and long-range westward); 2) REC (northeastward); 3) 
TOTL (westward); and 4) CY50 (southeastward). 

_ Because the largest forecast errors are associated with cyclone turning motion, 
cross-track (CT) and along-track (AT) components are calculated in terms of left (L), 
straight (C) and right (R) turning cyclones, and slow (S), central (C) and fast (F) 
Eme Categories relative to the CLIPER track. The results are consistent with 
systematic error biases: 1) OTCM (short-term rightward/slow and long-term 
leftward/fast); 2) REC (rightward/fast); 3) TOTL (leftward/fast); and 4) CY50 
(nghtward/slow). The biases in the OTCM may be a result of a pre-processing 
technique that attempts to correct the initial bias, but overcompensates in the long 
Ramee, [һе REC bias may be caused by its selection of only recurving analogs, 
Whereas the selection of analogs from the total sample (TOTL) results in a leftward 
bias for the recurving storms that are included. The rightward/slow CY50 bias may 
result from the tendency for western north Pacific cyclone motion to be left-of-track 
and faster than the 500 mb steering flow (beta-effect). 

The stratification of error statistics by storm-related and synoptic parameters 


provided distinct conditions associated with tropical cyclone motion. These 


101 


characteristics are summarized in terms of skill in path (CT) or speed (AT) prediction 
relative to a CLIPER forecast at 24, 48 and 72 h in Tables 1 - 3, respectively. 

Dynamical model (OTCM). Consistent with the result of previous studies 
(Tsui, 1984; Elsberry and Peak, 1986), the OTCM has the best overall mid-range (Table 
2) and long-range (Table 3) performance as a result of superior path prediction skill. 
The 24 h OTCM performance (Table 1) is poor relative to a CLIPER Гогесаз ан 
result of an initial rightward/slow bias. A pre-processing technique corrects some of 
this intial bias and gives the OTCM excellent mid- and long-range skill. However, 
overcompensation by this technique may cause the long-range leftward;fast bias that 
contributes to the poor performance on north zone, western area and medium size 
cyclones. 

Analogs (REC and TOTL). The REC rightward track bias due to selectiogngen 
only recurving analogs causes large errors in forecasting left-turning and 
straight-moving storms. With the exception of path skill on medium size stornis КРЕ 
has no long-range prediction skill (Table 3) relative to a CLIPER forecast. 

The selection of analogs from the total sample (TOTL) results in errors due to 
missed recurvature forecasts (westward bias). However, the selection of both fast and 
slow analogs results in superior speed prediction skill, especially at 48 h (Table 2). The 
superior peformance of CLIPER relative to TOTL indicates a problem in the 15005) 
the analog scheme as CLIPER and TOTL are based on similar data bases. 

Steering (CY50). Although CY50 is the best aid for short-range forecasts 
(Table 1), a significant decline in skill is observed after 24 h. Without the physics of 
the OTCM or the climatology influence in the analog techniques, the CY50 becomes 
the worst aid for mid- to long-range forecasting. 

2. Recommendations for research 
The following recommendations for future research are suggested: 

1) MFE (normalized by CLIPER), systematic and CT/AT error statistics should 
be calculated on other objective aids in. operational use, or undergoing testing 
and evaluation. The results could be published in the JTWC Annual Tropicai 
Cyclone Report (ATCR). 


2) Larger,samples are needed for additional stratifications by storm-related апа 
synoptic parameters. 


3) The environmental description in terms of the complete set of EOF coefficients 
provides a quantitative stratification relative to all of the synoptic features, 
rather than just the subtropical ridge (Xu and Gray, 1952). However, only two 
of the EOF coefficients have been used here. Some type of "cluster analysis" of 
ааа coefficients into distinct synoptic patterns (a map tvping) would be 
useful. 


TABEE 1 


SUMMARY OF OBJECTIVE AID 24 H PERFORMANCE 





OTCM REC ТЕ CY50 
LATITUDE 
NORTH P P 
CENTRAL 
SOUTH р S 
LONGITUDE | 
WESTERN 5 5 Р | 
MIDDLE S P 
EASTERN P/S | 
 Ш 5 | 
[NTENSE S P | 
MODERATE P 5 P 
WEAK P/S 
12-Hour ІС | 
WEAKENING Ш/5 | 
[NTENSIFYING 5 P 
RAPIDLY INTEN. DAS 
ӨЛГДЕ 
E LARGE S S 
MEDIUM š PIS 
SMALL AS 
SYNOPTIC 
SUBGROUP 1 S S 
SUBGROUP 2 P P P 
SUBGROUP 3 P/S S 5 
SUBGROUP Ч P/S 


РА Ратна с о 5 = SPEED Stitt, М « NO SKILL 
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TABELLIS 
SUMMARY OF OBJECTIVE AID 43 PER PCG IE 


LATITUDE 
NORTH Р 
CENTRAL P 5 
SOUTH P/S 
LONGITUDE 
WESTERN P 
MIDDLE В) 
EASTERN P S 
ЕТ 
[NTENSE Г 5 
MODERATE р 3 3 
WEAK P 5 
12-почя IC 
WEAKENING S S P 
INTENSIFYING P 5 
RAPIDLY ІМТЕМ, Рд, 
SIME 
LARGE PS 
MEDIUM 25 p 
SMALL P 5 
SYNOPTIC 


SUBGROUP 1 

SUBGROUP 2 P/S 

SUBGROUP 3 DS p 

SUBGROUP 4 PAS PIS PIS 


P = PATH SKILL. S = SPEED SKILL. = NO SKILL 
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ВАС ВЕЕВ 
о: ОЕ ОЕ Е At 72H PERFORMANCE 





REC TOTL DM 
LATITUDE 
NORTH S P 
CENTRAL P S | 
SOUTH P Š 
LONGITUDE | 
WESTERN 
MIDDLE 5 P 
EASTERN P 5 | 
INTENSITY | 
[NTENSE S | 
MODERATE P S | 
WEAK P S | 
12-Houn IC 
WEAKENING S P 
[NTENSIFYING P S 
RAPIDLY INTEN, RES 
5125 
1 LARGE ps 
MEDIUM В 5 
SMALL P 5 
SYNOPTIC 
SUBGROUP ] 
SUBGROUP 2 В Š 
SUBGROUP Jj P/S Š 
SUBGROUP 8 
Р = PATH SKILL, S = SPEED SKILL, = NO SKILL 
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APPENDIX A 
STORM-RELATED PARAMETER PINEA OF CLASS En 


Each table in this appendix contains three colums which correpond to different 
values of a storm-related parameter. Each column contains a 3 X 3 table of the 
percentage of zero-, one- and two- class errors. The numbers in the left column 
represent "correct" forecasts and are referred to as zero-class errors. пе песници 
errors consist of objective aid forecasts on the opposite side of the CPI P ни 
compared to the best track. These errors are located in the right column. песен 
column contains one-class errors in which the objective aid forecast 1s displaced only 
one tercile from the best track. The lower portion of the table оппатаг е 08 
percentage of class errors for each category (L, C and R or S, C and F). A Мезошки 
is also provided for each forecast period. The M-score is a linear measure which 
penalizes an objective aid more (twice) for having two-class errors (M = V + 2W), 
where U, V and W are the percentages of the zero-, one- and two- class errors ( U + 
V+ W = 100% ). 
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Figure A.7 As in Fig. A.1, except for longitude < 129°E. 
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Figure A.8 Asin Fig. A.2, except lor longitude ы 
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Figure A.9 Asin Fig. A.1, except for longitude between 129 and 140°E. 
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